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ABSTRACT 

We extend our study of the optimization of large baryon acoustic oscillation (BAO) 
surveys to return the best constraints on the dark energy, building on Paper I of this 
series (Parkinson et al. 2007). The survey galaxies are assumed to be pre-selected 
active, star-forming galaxies observed by their line emission with a constant number 
density across the redshift bin. Star-forming galaxies have a redshift desert in the re- 
gion 1.6 < z < 2, and so this redshift range was excluded from the analysis. We use the 
Seo & Eisenstein (2007) fitting formula for the accuracies of the BAO measurements, 
using only the information for the oscillatory part of the power spectrum as distance 
and expansion rate rulers. We go beyond our earlier analysis by examining the effect 
of including curvature on the optimal survey configuration and updating the expected 
'prior' constraints from Planck and SDSS. We once again find that the optimal sur- 
vey strategy involves minimizing the exposure time and maximizing the survey area 
(within the instrumental constraints), and that all time should be spent observing in 
the low-redshift range (z < 1.6) rather than beyond the redshift desert, z > 2. We 
find that when assuming a flat universe the optimal survey makes measurements in 
the redshift range 0.1 < z < 0.7, but that including curvature as a nuisance parameter 
requires us to push the maximum redshift to 1.35, to remove the degeneracy between 
curvature and evolving dark energy. The inclusion of expected other data sets (such as 
WiggleZ, BOSS and a stage III SN-Ia survey) removes the necessity of measurements 
below redshift 0.9, and pushes the maximum redshift up to 1.5. We discuss consid- 
erations in determining the best survey strategy in light of uncertainty in the true 
underlying cosmological model. 

Key words: cosmological parameters - large-scale structure of universe - surveys 



1 INTRODUCTION 

The discovery of the accelerating universe, driven by some 
mysterious dark energy, has motivated the conceptualization 
and design of a number of future surveys that will seek to dis- 
cover its nature. These include, but are not limited to: Wide- 
field Fiber-fed Multi-Object Spectrograph (WFMOS), the 
Dark Energy Survey (DES), Panoramic Survey Telescope & 
Rapid Response System (Pan-STARRS), Baryon Oscillation 
Spectroscopic Survey (BOSS), Large Sky Area Multi-Object 
Fibre Spectroscopic Telescope (LAMOST), Hubble Sphere 
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Hydrogen Survey (HSHS), Square Kilometre Array (SKA), 
Large Synoptic Survey Telescope (LSST), Euclid and the 
Joint Dark Energy Mission (JDEM). These will deploy an 
array of methods to probe the dark energy, such as baryon 
acoustic oscillations (BAO), weak lensing, cluster number 
counts, and type-la supernovae (SN-Ia). 

In such a crowded marketplace it is important to have 
a compelling product by demonstrating effective use of re- 
sources. In previous papers some of the present authors have 
examined the application of design principles to the con- 
struction of new surveys, by optimizing the surveys to give 
the best science return (Bassett 2005; Bassett, Parkinson & 
Nichol 2005a). Also, recently a team commissioned by the 
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US NSF (the Dark Energy Task Force or DETF) laid out a 
'roadmap' of how dark energy experiments may develop into 
the future (Albrecht et al. 2006), and similar studies have 
been undertaken by UK and European funding agencies. 

This paper is a contirmation of our previous work 
(Parkinson et al. 2007, hereafter P07), in which we con- 
sidered optimizing a BAO survey similar to the WFMOS 
design.^ The conceptual design for the WFMOS dark energy 
survey is to conduct a large area survey of the sky, measur- 
ing the rodshifts of order millions of galaxies. The power 
spectrum of these galaxies traces the power spectrum of the 
underlying matter density, and this contains the imprint of 
the primordial sound waves in the photon-baryon plasma 
(the BAO). These 'wiggles' in the power spectrum can be 
used as standard rulers to measure the angular-diameter dis- 
tance (c^a) from those modes transverse to the line of sight, 
and the Hubble rate at that redshift {H{z)) from the radial 
modes. For a description of WFMOS, see Bassctt, Nichol 
& Eisenstein (2005b). Very similar surveys have been pro- 
posed for LAMOST (Wang et al. 2009) and the 4-m Mayall 
telescope (BigBOSS; Schlegel et al. 2009b). 

In P07 we set out the basics of our optimization method- 
ology, defining the concepts of a Figure of Merit (FoM) , very 
similar to the one proposed by the DETF but now as a 
function of survey strategy, and a survey parameter space, 
where a particular survey configuration is defined in terms of 
time, area and redshift. When these survey parameters are 
combined with information about the instrument, we can 
predict the number of galEixies that will be observed, the 
accuracy with which the BAO will be measured, and the 
resulting FoM. By plotting how the FoM varies with sur- 
vey parameters, we can find the optimal survey. We found 
that the optimization preferred the surveys to be as largo in 
area as possible, limiting the exposure time to be as small 
as possible, to beat down the shot noise from limited galaxy 
numbers. 

In this paper we address the issues of the survey red- 
shift ranges in the high and low-redshift regimes, and the 
time spent observing in each of them. We see how these sur- 
vey parameters are affected by the cosmological parameters 
being considered, and by the other surveys that are included 
as priors in the analysis. 

In Section 2 we briefly review the details of our previous 
optimization, before describing the details of how our anal- 
ysis has been updated. In Section 3 we state the optimal 
configurations for a WFMOS-likc survey by itself. In Sec- 
tion 4 we look at the effect on the optimal survey design of 
adding in other experimental data as 'prior' measurements. 
In Section 5 we outline our conclusions. 



2 OPTIMIZATION PROCEDURE 
2.1 Survey definition 

We perform our optimization as described in P07. We con- 
sider a set of allowed survey geometries, described by the 

^ As of May 2009 the original WFMOS project has been termi- 
nated through lack of sufficient available funding via the Gemini 
Observatory, but our methodology and qualitative conclusions are 
generally applicable to any similar future proposals. 
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Figure 1. A schematic illustrating how the survey parameters 
are defined. The survey volume is defined by the area on the sky 
and the minimum and maximum rcdshifts. The redshift range is 
subdivided into a number of slices of fixed width dz for computing 
the FoM. The number density is fixed by the density in the final 
redshift slice (the shaded region) for a given exposure time. 



Table 1. List of survey parameters in each redshift regime. See 
Parkinson et al. (2007) for detailed explanations. Note that we 
no longer vary the number of redshift bins, but instead divide up 
the redshift ranges into thin slices for the FoM calculation. 



Survey Parameter Symbol 

Survey time T|ow, "Hiigh 

Area covered ^lowi ^high 

Minimum of redshift bin zio-^ (min), z^igh (min) 

Maximum of redshift bin ziow (max), Zhigh (max) 
Number of pointings np(low), np(high) 



parameters listed in Table 1, and illustrated by a schematic 
in Figure 1. A general survey is divided into low- and high- 
redshift components, the former corresponding to z < 1.6 
and the latter z > 2, separated by the redshift desert within 
which ground-based surveys cannot efi'ectively obtain red- 
shifts due to the lack of galaxies emitting in the optical wave- 
lengths. The terminology 'low' and 'high' has this meaning 
throughout. 

The survey parameters are limited by some constraints, 
listed in Table 2. These are the same as in P07, with the 
exception of the limits on the redshift bins (zmin, 2max), 
which have been relaxed as we now include a more reason- 
able model of the efficiency /response of the WFMOS spec- 
trograph to light at different wavelengths. The details of 
this wavelength throughput are not public, but can be taken 
to be very similar to that of the Sloan Digital Sky Survey 
(SDSS) spectrographs.^ 

Having established the details of the survey, we com- 
pute the total number of galaxies that will be measured. We 
assume a pre-existing source catalogue of photometrically 
selected galaxies, from which we can effectively target ei- 
ther line-emission active star-forming galaxies or passively- 
evolving continuum emission galaxies. These details have 
not changed from the previous paper. Since we found in P07 
that the active star-forming galaxies, whose redshifts are to 
be obtained by measuring the 0[II] emission line doublet at 

^ Details of the SDSS spectrographs can be found at 
http://www.astro.princeton.edu/PBOOK/spectro/spectro.htm 
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Table 2. List of constraint parameters. 



Constraint Pajrameter 



Value 



Total observing time 
Field of view 

^fibres 

Aperture 
Fibre diameter 
Overhead time between exposures 
Minimum exposure time 
Maximum exposure time 
Wavelength response 
Width of redshift slices, dz 



1500 hours 
1.5° diameter 
3000 
8m 
1 arcsec 
10 mins 
15 mins 
10 hours 
Priv. comm with AAO 
0.05 



low redshift and Lyman-a at high redshift, are the preferred 
targets, we adopt these as standard for all the analysis in 
this paper. We also set a somewhat arbitrary lower limit of 
15 minutes for the exposure time, representing a reasonable 
compromise when taking into account a rather pessimistic 
estimate of a 10 minute overhead time between exposures. 
We further assume that the galaxies are targeted so as to 
generate a sample of uniform number density across each 
redshift bin. 

Wc also include an estimate of the bias of these galaxies, 
and its evolution with redshift. At low redshift we take Wake 
et al. (2008) as our guide, assuming the bias (weakly) tracks 
the linear growth function, using the following formula 



b{zio) = 1 + {b{zhi - 1)D(zm)/D{zio) ., 



(1) 



where D{zQ is the growth function. Here we take Zhi = 0.55 
and b{zhi) = 1.3 At high redshift we use the result of Myers 
et al. (2007) that the bias grows as (1 + zf. 

Once the redshift ranges and number of galaxies have 
been determined, the cosmological parameter analysis can 
proceed. Here we slice the redshift bins into a number of 
sub-bins, where the width of these sub-bins is fixed and the 
number is determined by the redshift range (as shown in 
Figure 1). We take the width of the redshift slices to be con- 
stant, dz = 0.05, with the redshift range always being an 
integer number of these slices and the minimum and maxi- 
mum redshifts discretized in the same units. 

In computing the BAO errors on each slice, we do not 
include the possible correlations between slices that may be 
caused by large-scale modes in the power spectrum. Our 
slice width dz is chosen to be fairly wide to reduce such cor- 
relations. These will have the effect of decreasing the con- 
straining power of the survey and so lowering the FoM. We 
do not necessarily expect including these effects to change 
the optimal survey, as they will not change the redshifts at 
which the measurements are being made, only the accuracy 
of the measurements. 



2.2 Figure of Merit (FoM) 

Once the area, redshift range and slices, and galaxy num- 
ber of the survey have been determined, we can use fitting 
formulae to estimate how well the BAO will be measured, 
and what distance information will be returned. In Rassat et 
al. (2008) a comparison was made between different meth- 
ods for extracting information from a future galaxy survey. 
Here, following on from P07, we only use the oscillatory 



part of the power spectrum (the 'wiggles'), as we consider 
this the most robust source of distance information that can 
be extracted. The full power spectrum is degenerate with 
primordial power spectrum parameters (tilt, running) and 
also details of the growth of structure on large scales (non- 
linear bias, non- linear growth). The anisotropy of the power 
spectrum can be used as am Alcock-Paczynski (AP) test, 
but this require details of the non-linear behavior of the 
redshift-space distortions. 

In P07 we used the formula published by Blake et al. 
(2006), but this has been superseded by those of Seo & 
Eisenstein (2007). We use the formula derived from a Fisher 
matrix approach, using a 2-D approximation of only the os- 
cillatory part of the power spectrum (equation 26 in their 
paper). These fitting formula estimate the errors in the po- 
sition of the baryonic features along and across the line of 
sight, as well as the correlation between them. They also 
have the added advantage that they can simulate the eff'ect 
of 'reconstruction' of the linear oscillations in the non-linear 
regime (though we do not use reconstruction in this paper). 
This can lead to increased accuracy at lower redshifts, where 
non-linear effects on the power spectra are present at the 
same scales as the BAO. The accuracies of the BAO mear 
surements leads to the calculation of the FoM. 

In P07, as in the DETF report, the CPL parameteriza- 
tion (Chevallier & Polarski 2001; Linder 2003) of the dark 
energy equation of state was used, given by 



w{a) =wo + Wa(l — a) 



(2) 



where wo and Wa are adjustable constants. The FoM we 

used in the previous paper was the D-optimal criterion, the 
inverse of the determinant of the {wo, Wa) covariance matrix, 
i.e. 

1 



FoMoid =det"^(C) 



(3) 



Here we have switched to the square root of the inverse of 
the determinant, bringing us into line with the DETF FoM, 



FoMnew = 



(4) 



where Wp is the equation of state at the 'pivot' redshift. 
Hence our new FoM is the square root of our old FoM. We 
use this new definition of the FoM throughout. 

The FoM is computed using a Fisher matrix approach. 
Details are laid out in Appendix A. 



2.3 Adding curvature 

Wc have expanded our cosmological parameter space from 
P07, by including the efi'ect of curvature on our analysis. The 
importance of doing so has been emphasized by Clarkson, 
Cortes k, Bassett (2007), who showed than even a small 
curvature can seriously bias dark energy measurements. Our 
cosmological parameter space (©) is now defined to be 



e = {wo. Wo, f^DE, fifc, /l, Ob/l^, Tls} . 



(5) 



The fiducial values for these parameters are given in Table 3. 
Additional parameters not allowed to vary are the radiation 
energy density f2r and the matter spectrum normalization 
as,. Note that the 'wiggles-only' method of BAO does not 
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Table 3. The fiducial cosmological parameters used in this paper. 



Parameter 


Value 


Wo 


-1 


Wa 







0.3 


Qr 


8.2 X 10-5 











Ho 


70 




0.0441 


ris 


1 




0.9 



constrain ag directly, it is included here as it is an input 
parameter into the Seo & Eisenstein (2007) fitting formula. 

We include the measurements of the BAO by SDSS and 
2dF (Eisenstein et al. 2005, Percival et al. 2007) as prior in- 
formation. The SDSS/2dF prior is the ratio of measurements 
of Dv at 2: = 0.2 and z = 0.35, where Dv is defined as 

Dv = lr^cz/H{z)]'/'. (6) 

The accuracy of this measurement is given in Percival et al. 
(2007). 

We also include measurements of the CMB by the 
Planck satellite (Mukherjee et al. 2008) as prior information. 
Planck will make accurate measurements of the distance to 
last scattering (R) and the position of the first peak (la), 
defined to be 

R=^/n:jllrizcMB), U = ^^I^^^. (7) 

rs{ZCMB) 

The accuracy of these measurements weis estimated by sim- 
ulating temperature and polarisation power spectra (i.e. us- 
ing TT, TE and EE), and running Markov Chain Monte 
Carlo (MCMC) chains to estimate the error on R and la, 
as described in Mukherjee et al. (2008). The results of this 
paper requires us to include Qhh^ and Ub in our analysis.^ 
We model the predicted Planck likelihood using the covari- 
ance matrix on these four parameters {R, la, Ob/i^ and Ug) 
given in Mukherjee et al. (2008). Note that the constraints 
on fihh^ and Ug only come from the CMB, and those param- 
eters would not be constrained by BAOs only. There is a loss 
of information in considering only the constraints on these 
four parameters rather than the full CMB power spectra, 
but Mukherjee et al. (2008) found that when considering 
constraints on Dark Energy models and combining this con- 
densed form of information with other distance probes this 
information loss is negligible. 

2.4 Searching the parameter space 

We search through the survey parameter space as in P07 
using simulated annealing, with long MCMC chains under- 
going thermodynamic scheduling (sec Corny 1985) to push 
them closer to the optimum. The FoM takes on the role of 

^ We could have included a prior from Big Bang Nucleosynthesis, 
which yields fl^h^ = 0.0214 ± 0.0020. However, Planck will con- 
strain Q\,h^ well enough that such a prior has a minuscule effect 
on the FoM, changing only the 4"* decimal place. 



the likelihood in parameter estimation MCMC, where the 
probability of moving from a survey configuration (s) to a 
new one (s') is given by 

By employing thermodynamic scheduling, we introduce a 
temperature T that modulates the probability of acceptance, 
thus 

. f, /FoM(s')\'^^l 
^(^-^')=mm|l,(^-^j |- (9) 

As the temperature of the chain goes from 'hot' to 'cold' 
the probability of accepting a survey with a smaller FoM 
rapidly diminishes. This technique is employed for example 
in Wit, Nobile & Khanin (2005), and has also been used 
in optimizing cluster surveys for probing the Dark Energy 
in Wu, Rozo &: Wechsler (2009), which appeared after this 
paper. 

The nature of optimization is that we are interested only 
in a tiny region of the survey parameter space, and so large 
numbers of chain elements arc not necessarily a guarantee of 
reaching the true global optirrmm. Some of the parameters 
we have included may have only small contributions to the 
FoM, or may actually be detrimental (e.g. observing at high 
redshift may reduce the FoM as it reduces the time that can 
be spent observing at low redshift). We therefore often run 
refinement searches, in a lower-dimensional parameter space, 
to speed up reaching the optimum. When the MCMC search 
indicates that some of the parameters (time spent at high 
redshift, exposure time etc) can be set to specific values, a 
follow-up search is carried out with these parameters fixed 
to refine the optimal survey. 

One aim of the optimization is to discover how far we 
can push the survey away from the optimum configuration 
without degrading the performance too much. For this we 
introduce 'flexibility bounds', which describe or delimit the 
region of parameter space where the FoM has fallen to 90% 
and 60% of the optimum vaJue. This idea was introduced 
in P07, but as we have changed our definition of FoM from 
that paper, we have also changed our definition of the flex- 
ibility bounds in line with that. The flexibility bounds are 
interesting as they show the relationship between survey pa- 
rameters, such as the survey area and time. 

2.5 Effect of methodology changes from Paper I 

As compared to P07, this paper makes significant changes to 
the methodology. On the observational side is an improved 
understanding of the WFMOS instrument, the adoption of 
the BAO fitting formulae of Seo & Eisenstein (2007) , and the 
improvement of prior information from SDSS and expected 
from Planck. On the theoretical side is the inclusion of cur- 
vature within the cosmological model. To illustrate the effect 
of these changes, we consider a 'standard', non-optimized, 
WFMOS survey outlined in Table 4. This is intended to rep- 
resent the sort of survey assumptions one might have made 
without optimizing. We compare three different calculations 
of the FoM. 

Under the old methodology, with a flat Universe, the 
FoM was 7. Improved understanding of the instrument and 
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Table 4. Survey pajrameters and FoMs for a 'standard' (non- 
optimized) survey (including Planck and SDSS as prior informa- 
tion) . 



Survey Parameter 


Value 


Alow (sq. degrees) 


2000 


Tiow (hours) 


800 


Zlow (min) 


0.5 


2low (max) 


1.3 


exposure time (minutes) 


32 


number density (Mpc~^ft.^) 


8.3 X IQ-* 


number of galaxies 


3.4 X 10^ 


-4high (sq- degrees) 


300 


Thigh (hours) 


700 


^high (min) 


2.3 


Zhigh (max) 


3.3 


exposure time (minutes) 


237 


number density (Mpc~^/i^) 


4.5 X lO""* 


number of galaxies 


5.5 X 10* 



FoM (old method, flat Universe) 7 
FoM (new method, flat Universe) 18 
FoM (new method, with curvature) 9 



additional prior information has indicated that it will bo 
significantly more powerful; under the same fiat Universe 
assumption the FoM is improved to 18, substantially reduc- 
ing the uncertainty of each of the two dark energy param- 
eters. Inclusion of curvature, however, necessarily degrades 
the outcome, lowering the FoM to 9. 



3 WFMOS OPTIMAL SURVEYS 

Wc break the results of the analysis down into the following 
subsections. In Section 3.1 we review the results from our 
previous work, then in Section 3.2 we look at the effect of 

adding curvature on the time split between the two redshift 
regimes. In Section 3.3 we discuss the best survey strategy 
in light of uncertainty in the true underlying cosmological 
model. In this section we only assume priors from SDSS and 
Planck. 

It would be possible to do an optimization for the ex- 
periment without any prior information, but it would be 
misleading to carry out such an optimization. The SDSS 
data already exists, and the Planck data will do soon (and 
even WMAP measurements might be good enough for this 
purpose) and the principal goal of optimization is to find the 
correct niche for an experiment. If a survey such as WFMOS 
were forced to spend time observing at high redshift to re- 
move the degeneracy with curvature, when it could just as 
easily do so by incorporating the results from Planck, this 
would be waste of time and resources, and the incorrect kind 
of optimization to perform. It is therefore imperative to ac- 
count for all relevant information already available when 
optimizing a future survey. 

3.1 Previous work 

In our previous paper we conducted an analysis where we 
varied only four parameters {wo, Wa, f^m and fim/i^), as- 
suming the Universe to be fiat so the dark energy density 



Table 5. Optimal survey parameters, optimized for a flat universe 
and including curvature as a nuisance parameter. The FoM is 
computed including prior information from Planck and SDSS, 
as described in the text. The parameters for the high redshift 

bin are not included as the optimal surveys spend all their time 
observing at low redshift. Wc also include the one sigma errors 
on the cosmological parameters predicted by the Fisher matrix 
approach for these optimal surveys. 



Survey Parameter 


Flat 


Curved 


Alow (sq. degs) 


6300 


6300 


-How (hours) 


1500 


1500 


ziow (min) 


0.1 


0.1 


^low (max) 


0.7 


1.35 


exposure time (mins) 


15.0 


15.0 


number density (/i^/Mpc'^) 


3 X IQ-'i 


6.6 X 10"* 


number of galaxies 


10.8 X 10^ 


10.8 X 10^ 


FoM 


57 


32 


a{wo) 


0.14 


0.23 




0.44 


0.70 


o-(nDE) 


0.012 


0.018 






2.5 X 10-3 



is given by fJoE = 1 — f2m- We found that the optimization 
preferred to concentrate all the survey time into the low- 
redshift regime. We also found that short exposure times of 

just a few miiuites on an 8-metre class telescope are suf- 
ficient to obtain redshifts for the majority of line-emission 
galaxies. Although a longer exposure time would result in 
higher quality spectra with fewer wasted fibres, it also re- 
duces the amount of area that can be surveyed during a fixed 
total survey duration. A large area is important to maximize 
the number of surveyed galaxies, so that the shot noise can 
be beaten down. The optimal surveys were therefore driven 
to the smallest allowed exposure time of 15 minutes. The 
best strategy was to ignore the possibility of high-redshift 
observations, as there were no parameter degeneracies that 
required such observations to break; them. 

We reanalyzed this case, taking into account all the im- 
provements we had made, but still assuming a flat universe 
where the curvature is not included as a nuisance parame- 
ter in the calculation of the FoM. We recovered very similar 
results to those given in P07. The optimal survey parame- 
ters are given in Table 5, and the FoM as a function of the 
survey parameters (for the low-redshift bin only) is shown 
in Figure 2. The detailed results of this analysis are shown 
in Figure Bl in Appendix B. 

The optimized survey represented a substantial gain in 
FoM with respect to the 'standard' survey. 

3.2 Adding curvature as a parameter 

We now want to understand the effect of including the cur- 
vature of the Universe as a free parameter in our analysis 
on the best survey. We continue to assume a flat fiducial cos- 
mology, but now require our observations to also constrain 
curvature. 

In Table 5 we show the optimal survey allowing for cur- 
vature as a nuisance parameter. We see that the optimal 
FoM is reduced, as the inclusion of an extra parameter (fifc) 
degrades the constraints on wo,Wa- We find once again that 
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Figure 2. The FoM as a function of the survey parameters, where 
the surveys have been optimized assuming a flat universe. The 
other parameters were chosen to maximize the FoM. The area 

and redshifts of the high-redshift bin have been omitted, as the 
optimal survey spends all its time observing at low-redshift. 



the preferred survey is one that spends all its time observing 
at low redshift. However, in contrast to the flat case, we see 
that the maximum redshift of the low-redshift bin is forced 
up to z = 1.35. BAO measurements at these higher redshifts 
are needed to remove the degeneracy between evolving dark 
energy and curvature. 

The FoM as a function of the survey parameters is 
shown in Figure 3, and the detailed results of this analy- 
sis are shown in Figure B2 in Appendix B. The position 
of the minimum of the redshift bin is unchanged from the 
flat (min) = 0.1, while the maximum «iow(niax) is 

pushed up to higher redshifts. 



Figure 3. The FoM as a function of the survey parameters, where 
the other survey parameters are chose to maximize the FoM. The 
surveys were optimized including curvature as a nuisance param- 
eter. 

3.3 The optimized survey strategy 

We begin by noting the significant impact that optimiza- 
tion can have in improving the science return. The FoM of 
the optimized case including curvature (32, from Table 5) is 
much larger than the FoM of the standard baseline survey 
(9 from Table 4) . The amount of reduction in the area of the 
error ellipse is 32/9 ~ 3.6, a large factor, and this is illus- 
trated in Figure 4. Put another way, the optimized survey 
would reach the same dark energy equation of state accuracy 
as the standard survey after only about one-quarter of the 
survey time. The reduced accuracy of the standard survey 
is because it spends time at high redshift which would be 
more productively spent at low redshift, and its low-redshift 
exposures are unnecessarily long. 
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Fisher Error Ellipse for Observables: 




-1.8 -1.4 -1 -0.6 -0.2 



Figure 4. The 68% error ellipse on the wq and Wa parameters, 
with marginalization over curvature, for the standard WFMOS 
survey (grey), and the optimized one (red). Also shown (yellow) 
is the error ellipse were the survey optimized for a flat Universe 
(but the errors have been computed here marginalizing over cur- 
vature). The difference between the largest ellipse and the two 
smaller ones shows the improvement due to optimizing the sur- 
vey for measuring the dark energy parameters, while the differ- 
ence between the smaller ellipses is due to different cosmological 
models (fiat or non-flat) used for the optimization. These con- 
straints are calculated including prior information from Planck 
and SDSS. 

Having established the importance of optimization, 
what considerations determine the optimal survey strategy? 
The principal uncertainty here is the form of the true cos- 
mological model. This is what we are trying to determine, 
and there must clearly be competing possibilities for the ex- 
periment to be interesting. As the optimal strategy depends 
on the (unknown) true cosmological model, there will in- 
evitably be choices to be made which have both costs and 
benefits. In the context of the models considered in this pa- 
per, the decision is whether to assume a flat Universe or to 
allow for curvature; there will be a cost if the assumption 
made in optimization turns out to be inappropriate once the 
data are obtained and analyzed. 

For the models we have considered here, the basic sur- 
vey decisions are independent of the assumed cosmological 
model. The first is that high-redshift observations are un- 
necessary — all survey time should be spent at low redshift 
{z < 1.6). The second is that the exposures should be as 
short as possible, as this is already sufficient to obtain the 
desired redshifts, and hence achieves maximal survey area. 
Finally, the low-redshift limit can be taken as starting at 
some suitably low value such as 0.1. 

The remaining decision to be made is the upper limit 
of the low-redshift bin. As we have already seen, the upper 
redshift limit is different depending whether we assume flat- 
ness or not. Table 5 gives the survey parameters for each 
case. 

Table 6 shows the FoMs, now with the extra informa- 
tion of the FoM that is returned if the true cosmology does 
not match the assumption made in optimizing. Naturally, 
for a given survey configuration, we get more accurate con- 



Table 6. Optimal survey Figure of Merit calculated in flat and 
curved cases, where the optimization has been undertaken under 
two different assumptions, either that Cj, is left out or included 
as a nuisance parameter. The FoM in computed including prior 
information from Planck and SDSS. 



Survey optimization 


without f2(; 


with fife 


FoM (S7j; set to zero) 


57 


48 


FoM (f2fc allowed to vary) 


15 


32 



60 




20 



' curved 

O ' ' 

0.5 1 1.5 

Z 

Figure 5. The FoM as a function of the upper redshift limit of 
the survey, for both the flat case and for the case including cur- 
vature. All surveys use Zniin = 0.1 and a minimal exposure time 
of 15 minutes, as discussed in the text. Measuring the curvature 
requires targeting a larger redshift range. 



straints if we assume a flat Universe than if we allow for 
curvature, as the extra parameter in the Fisher matrix di- 
lutes the constraining power on dark energy. However, we 
can now see the losses due to non-optimality. For example, 
if the Universe really is flat, but we optimized to allow for 
curvature, our FoM is degraded from 57 to 48. If we end up 
needing to allow for curvature, having not optimized for it, 
the degradation is from 32 to 15 (the corresponding error 
ellipses for this case are shown in Figure 4). 

Figure 5 shows the FoMs as a function of the upper 
redshift limit of the survey (reproduced from Figures 2 and 
3), showing the peaks at Zmax ~ 0.7 in the fiat case and 
Zmax ~ 1-35 in the curved one. There is no optimal way 
to deal with this tension, as one's opinions as to how likely 
the model assumptions are governs whether the benefits of 
a particular choice are likely to outweigh the costs. In this 
particular case existing evidence tends to support a flat Uni- 
verse (Vardanyan, Trotta & Silk 2009) suggesting that the 
potential loss of accuracy in the flat case outweighs the abil- 
ity to measure curvature. If we were considering different 
dark energy models/parameterizations, the choice may be 
less clear cut. 
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Table 7. Best survey parameters when including other data sets. 
The parameters for the high redshift bin are not included as the 
optimal surveys spend all their time observing at low redshift. 
We also include the one sigma errors on the cosmological param- 
eters predicted by the Fisher matrix approach for these optimal 
surveys. 



Survey Parameter 


SN-Ia, 


SN-Ia, 




WiggleZ & 


WiggleZ & 




BOSS 


BOSS (+QSO) 


Alow (sq. degs) 


6300 


6300 


Tiow (hours) 


1500 


1500 


2low (min) 


0.9 


0.1 


Zlow (max) 


1.55 


1.6 


exposure time (mins) 


15.0 


15. 


number density {h^ Mpc~^) 


6.7 X 10-* 


6.3 X 10"* 


number of galaxies 


8.9 X 10^ 


9.2 X 10"^ 


FoM 


72 


80 


(7{wo) 


0.12 


0.21 




0.41 


0.38 


o-(Odb) 


0.010 


0.009 


o-(Qfe) 


1.9 X 10-3 


1.8 X 10-3 



4 COMBINING WFMOS WITH OTHER DATA 
SETS 

Now we consider the effect of including constraints from 
other dark energy surveys that will have been undertaken 
prior to the WFMOS-like survey. We remind the reader 
that we always include SDSS and Planck data. Not includ- 
ing these data sets while allowing curvature to vary would 
change the optimal survey - but since that data is available 
or will soon be, we would end up with a sub-optimal sur- 
vey. An important question is then whether other planned 
surveys could also have a strong impact on the optimisation. 

Here we consider a generic stage III type-la Supernovae 
survey similar to that outlined in the DETF report (Albrecht 
et al. 2009), a BAG survey similar to that expected to be 
completed by WiggleZ (Blake et al. 2009) , and another BAG 
survey planned to be undertaken by BOSS (Schlegel, White 
& Eisenstein 2009a). BOSS will use measurements of the 
Lyman-alpha forest from quasar spectra to reconstruct the 
BAG at high redshift {z — 2.5). Since this is still somewhat 
speculative and has not yet been demonstrated, we consider 
two cases here, one where the QSG contribution is left out, 
and another where it is included. 

In Section 3 we saw that a survey covering the range 
0.1 < z < 1.35 was favoured with a high FoM. The ques- 
tion we ask now is whether the predecessor experiments will 
provide good enough measurements of these low-redshift re- 
gions to drive the preferred redshift range higher. 

The optimal survey parameters are shown in Table 7. 
The survey parameters as a function of FoM is shown in Fig- 
ure 6, in both the cases without and with the QSG measure- 
ment being included (the full results are shown in Figures 
B3 and B4 in Appendix B). 

Firstly we see that the maximum redshift of the low- 
redshift bin has increased from 2:iow(max) = 1.35 to 
-Ziow(inax) ~ 1.55 — 1.6. The minimum redshift of the low- 
redshift bin no longer peaks at the lowest possible value (as 
we see from Figure 6), and the FoM is independent of its 




Figure 7. The 60% and 90% flexibility contours for the time and 
redshift for the low-redshift bin in the case for WFMOS by itself 
(upper plot), and WFMOS combined with other prior surveys 
(lower plot). We can see how the flexibility bounds increase when 
the prior knowledge is stronger and the experiment has less of an 
impact. 

value up to 2; = 0.9. Since the lower redshift range is already 
covered by these other experiments, time that could have 
been spent in that range provides equal value if redeployed 
to 0.9 < z < 1.6. A high-redshift bin is again not required, as 
the low-redshift bin (at 0.9 < z < 1.6) combined with these 
other experiments is enough to measure the parameters to 
sufficient accuracy. 

As the extra data sets are included, the ffexibility 
bounds on the survey parameters are expanded. Since the 
flexibility bounds are given as a percentage of the peak FoM, 
the survey we are optimizing actually has less of an impact 
on the total FoM as other data sets are introduced (this is in 
contrast to parameter estimation, where more data sets nor- 
mally decrease or 'tighten' the confidence limits on a given 
parameter). This is very visible in Figure 7, where in the 
case where the other data sets are added, the 60% flexibility 
bounds cover most of the possible survey parameter space. 
Taken to its logical extreme, a survey which adds little or 
nothing to the state of knowledge will have infinitely large 
flexibility bounds, as no survey configuration will change the 
FoM. Such a survey would be obsolete, and there would be 
little scientific gain in undertaking it. This gives an effective 
'window of opportunity' for a WFMOS-like survey, which 
will still make gains over BOSS, but must be undertaken 
before a future all-sky dark energy survey (SKA, LSST or 
JDEM/Euclid), which will have very powerful constraints on 
the dark energy from a suite of observables (BAO, SN-Ia, 
weak lensing and cluster number counts). 
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Figure 6. The FoM as a function of the survey parameters when other experiments are included as prior information, with the QSO 
point not included (on the left), and additionally included (on the right). The extra data at low redshift, z < 1, moves the optimal 
WFMOS survey to a higher redshift of 0.9 < z < 1.55. The dashed lines show the FoM of the other experiments without WFMOS. 



We show the FoM and parameter errors predicted for 
different surveys individually and combined in Table 8. 



5 CONCLUSIONS 

We performed an analysis of the optimal dark energy sur- 
vey that could be carried out in a given time period by an 
experiment similar in design to WFMOS. We estimate the 
accuracy of the distance measurements that utilize only the 
oscillatory part of the power spectrum (the 'wiggles'), using 
the fitting formula of Seo & Eisenstein (2007) . Our measure 



of utility, or FoM, was defined to be proportional to the area 

of the error ellipse for the CPL parameters of the dark en- 
ergy equation of state. Our results can be summarized as 
follows: 

• The high-redshift bin always gives negligible benefit, 
with the optimal surveys spending all the available time ob- 
serving at low redshift, z < 1.6. The 1.6 < a < 2 region is 

the redshift desert where observatious of star-forming galax- 
ies are impossible, so 2 = 1.6 represents a hard limit on the 
optimization. 

• The survey area is always the maximum possible (6300 
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Table 8. FoM and parameter errors for the different surveys that 
we expect to be available when the WFMOS survey takes place 
(including the prior information from SDSS and Planck for each 
of them). TaJjing the existence of these surveys into account can 
significantly change the optimization results (see text). 



Survey 


FoM 


(7(wo) 




WigglcZ 


1.1 


1.1 


4.25 


SN-Ia (stage III) 


3.7 


0.46 


2.5 


BOSS (no-QSO) 


6.6 


0.47 


1.98 


BOSS (+ QSO) 


21 


0.21 


0.71 


WFMOS 


34 


0.21 


0.64 


Combined 


80 


0.12 


0.37 



square degrees under our assumptions) with the exposure 
time per field of view always as close as possible to the 
minimum allowed (15 minutes, more than enough to ob- 
tain spectroscopic rcdshifts for the majority of line-emission 
galaxies on an 8- metre class telescope). 

• The principal optimization decision to be made is the 
upper limit of the low-redshift range, with different values 
favoured depending on the cosmological model assumptions 
made. 

• Assuming a flat universe and no external data (beyond 
Planck) an upper limit of z = 0.7 is sufficient. The introduc- 
tion of curvature requires the survey to push up to z = 1.35 
for WFMOS alone. 

• The inclusion of external data sets, such as planned 
Supernovae and BAO surveys whose results may predate 
the running of a WFMOS-Iike survey, changes the optimal 
redshift range. The optimal maximum redshift of the low- 
redshift bin is moved up to z = 1.55. These data make good 
measurements of the dark energy properties at 2 < 1, the 
FoM is insensitive to the minimum of the low-redshift bin 
as long as ziow(iiiin) < 0.9. 

We find some of our conclusions of the optimal BAO 
surveys to be comparable to the optimal configurations of 
other Dark Energy surveys. The max;imization of the sur- 
vey area is the optimal configuration in both Weak Lonsing 
(Yamamoto et al., 2007) and ISW surveys (Douspis, et al., 
2008). However, these types of surveys are not so sensitive 
to the choice of redshift range as BAO surveys. 

It would be possible to go beyond the flat ACDM model 
with the dark energy equation of state described by some- 
thing different to the CPL parameterization. One example 
would be a form of w{z) that remains constant at early times 
before undergoing a rapid transition at some redshift to a 
negative value at late times to drive the acceleration. This 
parameterization has been studied in a number of publi- 
cations (Bassett et al. 2002; Corasaniti & Copeland 2003, 
etc). However, the constraints on the parameters of this pa- 
rameterization are often non-Gaussian, and so the predicted 
constraints using a Fisher matrix approach are often incor- 
rect (when checked against a more rigorous analysis using 
MCMC techniques). While we investigated optimal surveys 
using this dark energy parameterization, the results proved, 
using present methodology, to be uncomfortably unreliable. 

We also showed that the flexibility bounds on the survey 
parameters expand as other datasets are added in as prior 
information. While the flexibility bounds should not be too 



narrow, as this could lead to fine tuning of the survey which 
may not be realizable in practice, when the flexibility bounds 
become too large it is because the instrument is having too 
small an impact — its contribution to the total science from 
all surveys up to that point will be negligible. This leaves a 
'window of opportunity' for a WFMOS-like survey such that 
it will be of scientific benefit if it is performed after WiggleZ 
and BOSS, but will become obsolete if it post-dates a full- 
sky BAO survey performed by ,JDEM, Euclid or SKA. 

Finally, the conclusion that an optimal WFMOS-like 
survey should target exclusively 0.1 < z < 1.5, aiming for 
the maximal possible area and therefore the shortest possi- 
ble exposure time allowing for redshift determination, has 
been shown here to be quite stable. While such a survey re- 
turns the maximal information gain on the dynamical dark 
energy parameters, other science cases could be made for a 
high redshift bin, such as using redshift space distortions to 
probe the growth of structure, and so the theory of gravity. 
The Dark Energy optimal survey would also not be as good 
for other science goals like galaxy evolution, which desire 
high signal-to-noise spectra rather than redshifts alone. As 
we have shown that such deeper exposures are of negligible 
benefit to the dark energy FoM, an instrument aiming to 
carry out both types of science would need to do so via sep- 
arate survey programmes, rather than by sharing of a single 
dataset. 
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APPENDIX A: FISHER MATRIX FORMALISM 

As in our previous paper (P07), we use a Fisher matrix 
approach to compute the predicted experimental constraints 
on the cosmological parameters. The Fisher matrix is defined 

to be 

a2(-ln£) 



Fa 



(Al) 



dBAdBB ' 

where C is the likehhood, and 9i is one of the cosmological 
parameters. By the Cramer-Rao bound, the inverse of the 
Fisher matrix gives an estimator of the smallest (co)variance 
of the parameters. 

In our previous work we computed the Fisher matrix 
exactly, but considerations of the parameter set being used 
and the experimental data that could be included meant 
that in this work we compute the Fisher matrix elements 
numerically.* 

We do this by first gathering up all the experimental 
data that will be considered (the WFMOS survey config- 
uration under consideration, Planck, the SDSS BAO point, 
plus whatever other datasets we are including) , and simulat- 
ing their observables (dA & H[z) for BAO experiments, R 
& la for Planck, di for supernovae experiments) at the fidu- 
cial cosmology, with no scatter in the mean values. Since the 
Fisher matrix is defined as the expectation of the Hessian of 
the log-likelihood, averaged over all possible realizations of 



the data, this averaging process removes the scatter in the 
mean of the data point. Then we use this to compute the 
likelihood in the region around the fiducial cosmology. 

We can compute the slope of a function through a finite- 
difference operation. For example, the slope of a function / 
evaluated at x can be given by 



fix + e) - fix - e) 
2e 



(A2) 



where e is some small positive number. As we are evaluating 
the likelihood at the fiducial cosmology, which should be 
identical to the maximum likelihood point, the slope of the 
likelihood in any direction should be zero, or as close to 
it as numerical accuracy will allow. Here we use the finite- 
difference method to compute the second derivative of the 
likelihood, evaluated at the fiducial cosmology. 

For each individual Fisher matrix element we take steps 
of size £ in both cosmological parameters. We can estimate 
the slope in the direction of one of the parameters at the 
displaced point of the other, i.e. 



a(-ln£(eB ±e)) 



d9A 



(A3) 



In CjOB ± e, 6'a + e) - In CjOB ± e, - e) 

2e 



(This holds also if 9a and Ob are exchanged.) From here 
our estimate of the second derivative is simply the finite 
difference of the slopes, evaluated at the slightly displaced 
positions. 



a^(-ln£) 
dOAddB 



1 

2e 



9(- In £(6(5 -he)) a(- ln£(6lB - e)) 



OOa 



OOa 



.(A4) 



We tune the step parameters e to be small enough to achieve 
numerical convergence of the Fisher matrix. 



APPENDIX B: 
RESULTS 



FULL PRESENTATION OF 



* Similar work by Bassett et al. (2009) has made such nu- 
merical computation available as a MATLAB toolbox (called 
Fisher4Cast), available at http://www.cosmology.org.za/ 
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Figure Bl. The optimal FoM as a function of the survey parameters (where the other parameters are chosen to maximize the FoM), 
for surveys optimized for a flat universe. The 2-d contours delimit the 90% and 60% flexibility bounds. We see the optimal survey is one 
that spends all its time at low redshift (timeio^^ = ISOOhrs) and maximizes the area in the low-redshift bin. We see that the high-redshift 
bin adds nothing to the FoM, and so it is insensitive to those parameters, except the time in the high-redshift bin which is minimized. 
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Figure B2. The FoM as a function of the survey parameters (where the other parameters are chosen to maximize the FoM), for surveys 
optimized including curvature as a nuisance parameter. The 2-d contours delimit the 90% and 60% flexibility bounds. We see the optimal 
survey is one that spends all its time at low redshift and maximizes the area in the low-redshift bin, but now the optimal maximum of 
the low-redshift bin is moved up to z = 1.35. As before, we see that the high-redshift bin adds nothing to the FoM, and so it is insensitive 
to those parameters, except the time in the high-redshift bin which is minimized. 
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Figure B3. The FoM as a function of the survey parameters for a WFMOS-like survey with other data sets (SN-Ia, BOSS, but without 
the QSO point at z=2.5, and WiggleZ) included as external datasets. The dashed line shows the FoM of the other surveys combined 
(including Planck), but without WFMOS. The 2-d contours delimit the 90% and 60% flexibility bounds. We see the optimal survey is 
one that spends all its time at low redshift and maximizes the area in the low-redshift bin. The FoM now peaks at z = 1.55 for the 
maximum of the low-redshift bin, but is insensitive to the minimum as long as 2io^(min) < 0.9. As before, we see that the high-redshift 
bin adds nothing to the FoM, and so it is insensitive to those parameters, except the time in the high-redshift bin which is minimized. 
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Figure B4. The FoM as a function of tlie survey parameters for a WFMOS-like survey with other data sets (SN-Ia, BOSS with the QSO 
point at z=2.5 and WiggleZ) included as external datasets. The dashed line shows the FoM of the other surveys combined (including 
Planck), but without WFMOS. The 2-d contours delimit the 90% and 60% flexibility bounds. We see the optimal survey is one that 
spends all its time at low redshift and maximizes the area in the low-redshift bin. The FoM now peaks at z = 1.6 for the maximum of the 
low-redshift bin, but is insensitive to the minimum as long as 2io^(min) < 0.9. Notice that the 60% flexibility bound now covers most of 
the survey parameter space. 



